Variational Gaussian Copula Inference
نویسندگان
چکیده
We utilize copulas to constitute a unified framework for constructing and optimizing variational proposals in hierarchical Bayesian models. For models with continuous and non-Gaussian hidden variables, we propose a semiparametric and automated variational Gaussian copula approach, in which the parametric Gaussian copula family is able to preserve multivariate posterior dependence, and the nonparametric transformations based on Bernstein polynomials provide ample flexibility in characterizing the univariate marginal posteriors.
منابع مشابه
Copula Variational Bayes inference via information geometry
Variational Bayes (VB), also known as independent mean-field approximation, has become a popular method for Bayesian network inference in recent years. Its application is vast, e.g. in neural network, compressed sensing, clustering, etc. to name just a few. In this paper, the independence constraint in VB will be relaxed to a conditional constraint class, called copula in statistics. Since a jo...
متن کاملGaussian Copula Variational Autoencoders for Mixed Data
The variational autoencoder (VAE) is a generative model with continuous latent variables where a pair of probabilistic encoder (bottom-up) and decoder (topdown) is jointly learned by stochastic gradient variational Bayes. We first elaborate Gaussian VAE, approximating the local covariance matrix of the decoder as an outer product of the principal direction at a position determined by a sample d...
متن کاملCopula variational inference
We develop a general variational inference method that preserves dependency among the latent variables. Our method uses copulas to augment the families of distributions used inmean-field and structured approximations. Copulas model the dependency that is not captured by the original variational distribution, and thus the augmented variational family guarantees better approximations to the poste...
متن کاملMultivariate Copula Spatial Dependency in One Bit Compressed Sensing
In this letter, the problem of sparse signal reconstruction from one bit compressed sensing measurements is investigated. To solve the problem, a variational Bayes framework with a new statistical multivariate model is used. The dependency of the wavelet decomposition coefficients is modeled with a multivariate Gaussian copula. This model can separate marginal structure of coefficients from the...
متن کاملA Theoretical Argument Why the t-Copula Explains Credit Risk Contagion Better than the Gaussian Copula
One of the key questions in credit dependence modelling is the specfication of the copula function linking the marginals of default variables. Copulae functions are important because they allow to decouple statistical inference into two parts: inference of the marginals and inference of the dependence. This is particularly important in the area of credit risk where information on dependence is ...
متن کامل